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BUMPING SEQUENCES AND MULTISPECIES JUGGLING 


ARVIND AYYER, JEREMIE BOUTTIER, SYLVIE CORTEEL, SVANTE LINUSSON, 

AND FRANQOIS NUNZI 


Abstract. Building on previous work by four of us (ABCN), we con¬ 
sider further generalizations of Warrington’s juggling Markov chains. 
We first introduce “multispecies” juggling, which consist in having balls 
of different weights: when a ball is thrown it can possibly bump into a 
lighter ball that is then sent to a higher position, where it can in turn 
bump an even lighter ball, etc. We both study the case where the num¬ 
ber of balls of each species is conserved and the case where the juggler 
sends back a ball of the species of its choice. In this latter case, we 
actually discuss three models: add-drop, annihilation and overwriting. 
The first two are generalisations of models presented in (ABCN) while 
the third one is new and its Markov chain has the ultra fast convergence 
property. We finally consider the case of several jugglers exchanging 
balls. In all models, we give explicit product formulas for the stationary 
probability and closed form expressions for the normalization factor if 
known. 


1. Introduction 

Several Markov chains studied in nonequilibrium statistical physics are 
known to have, despite nontrivial dynamics, an explicit and sometimes re¬ 
markably simple stationary state. The most famous examples of these are 
one-dimensional models of hopping particles such as the asymmetric exclu¬ 
sion process [ 5 ], where the stationary state satisfies the so-called matrix 
product representation [4] and the zero-range process, where the stationary 
state is factorised |8]. The main reason for this simplicity is the underlying 
combinatorial structure of these processes. Of the two examples mentioned 
above, a variant of the former known as the totally asymmetric simple exclu¬ 
sion process (TASEP), solved first in [6], has a rich combinatorial structure 
even when the system is generalised to include several types of particles. The 
latter system is known as the multispecies TASEP , and its stationary state 
has an explicit solution which comes from queueing theory [5j. 

The multispecies TASEP has the further exceptional property that the 
stationary state can also be calculated if the hopping probabilities of par¬ 
ticles depend on their location, known as the inhomogeneous multispecies 
TASEP. This was first done for the three-species case in |3] and the result 
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for arbitrary species has been announced in [12] • While the stationary state 
of the general inhomogeneous multispecies TASEP has an explicit descrip¬ 
tion in principle, the actual formulas for the stationary probabilities can be 
considerably complicated. 

In this paper, we will first study the multispecies variants of the basic 
juggling process introduced in m then extended to their inhomogeneous 
versions in m m- In contrast to the TASEP, as we will show in Theorem[5] the 
stationary probabilities and the partition function have elegant and compact 
expressions. We then study the multispecies variants of two other juggling 
processes, which were also introduced in [13] . where the number of balls of 
each type can vary. In all of these cases, we prove analogous results; see 
Theorems and EH We also introduce a new model where the number 
of balls of each type can vary that we call the overwriting model. This 
model has the nice property that it converges to its stationary distribution 
in deterministic finite time. 

The rest of the paper is organized as follows. In Section [2j we discuss 
in some detail the first model, the so-called Multispecies Juggling Markov 
Chain (MSJMC): Section 2.1 provides its definition and the expression for 
its stationary distribution, and Section [2.2| is devoted to the enriched chain. 
Other models with a fluctuating number of balls of each type (but with a 
finite state space) are considered in Section [3j we introduce the multispecies 
extension of the add-drop and the annihilation models studied in [T] in the 


respective Sections 3.1 and |3.2| In Section 3.3, we present the overwriting 
model. Finally, in Section [l] we describe another possible extension of the 
juggling Markov chain of m, that involves several jugglers. 


Remark 1. Our proofs were mainly obtained by a classic combinatorial ap¬ 
proach which consists of introducing an enriched chain whose stationary 
distribution is simpler, and which yields the original chain by a projection 
or “lumping” procedure, see e.g. eh Section 2.3.1]. Let us summarize this 
strategy. Suppose we have a Markov chain on the state space S (which will 
be a finite set in all cases considered here), with transition matrix P (which 
is a matrix with rows and columns indexed by S, such that all rows sum 
up to 1), and for which we want to find the stationary distribution, namely 
the (usually unique) row vector n whose entries sum up to 1 and such that 
irP = 7r. The idea is to introduce another “enriched” Markov chain on a 
larger state space S with transition matrix P, which has the two following 
properties: 

• its stationary distribution tt is “easy” to find (for instance we may 
guess and then check its general form because its entries are integers 
with nice factorizations, or monomials in some parameters of the 
chain), 

• it projects to the original Markov chain in the sense that there exists 
an equivalence relation ~ over S such that S can be identified with 
S/ ~ (i.e. the set of equivalence classes of ~), and such that the 
lumping condition 

X! = P[ x \-[v\ 

y'~y 


(1) 
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is satisfied for all x, y in S, where \x\ e S denotes the equivalence 
class of x. 

Then, it is straightforward to check that the stationary distribution it of the 
original Markov chain is given by 



( 2 ) 


In principle, there may be a large number of terms in the right-hand side of 
([2]), making the resulting stationary distribution 7r nontrivial. 

For all the juggling models, we prove that the Markov chain is aperiodic 
and irreducible. This implies that the stationary distribution is unique. For 
the enriched chains, we do not prove irreducibility (even though all the chains 
are conjectured to be irreducible). Computing a stationary distribution and 
lumping is enough to get the unique stationary distribution of the original 
chain. 

Most of the results of this paper have been previously announced in the 
conference proceeding [2|. 


2. MULTISPECIES JUGGLING 


2.1. Definition and stationary distribution. The first model that we 
consider in this paper, and for which we give the most details, is a “multi- 
species” generalization of the so-called Multivariate Juggling Markov Chain 
(MJMC) p. Colloquially speaking, the juggler is now using balls of different 
weights, and when a heavy ball collides with a lighter one, the lighter ball is 
bumped to a higher position, where it can itself bump a lighter ball, and so 
on, until a ball arrives at the topmost position. Should the reader find this 
model unrealistic, she may instead think of a lazy referee “juggling” with a 
stack of papers of varying priorities to review: every day the referee takes the 
paper on the top of the stack but, after spending his time on other duties, 
decides to postpone it to a later date, possibly bumping a less important pa¬ 
per further down the stack, etc. Formally, our Midtispecies Juggling Markov 
Chain (MSJMC) is defined as follows. 

Let T be a fixed positive integer, and m,..., ut be a sequence of positive 
integers. The state space St ni! ... } n T of the MSJMC is the set of words on 
the alphabet {1 ,,T} containing, for all* = 1 ,,T, m occurrences of the 
letter i (the letter 1 represents the heaviest ball and T the lightest one). Of 
course those words have length n = n\ + ■ ■ ■ + ut, and there are ( ni n ) 
different states. 

To understand the transitions, it is perhaps best to start with an example, 
by considering the word 132132 (i.e. T = 3, ni = n 2 = = 2). The first 

letter 1 corresponds to the ball received by the juggler: it can be thrown 
either directly to the rightmost position, i.e. to the top (resulting in the 
word 321321), or in the place of any lighter ball. Say we throw it in place 
of the first 2. This 2 can in turn be thrown either to the rightmost position 
(resulting in the word 311322), or in the place of a lighter ball on its right: 
here it can only “bump” the second 3, which in turn has no choice but to go to 
the rightmost position, resulting in the word 311223. This latter transition 
is represented on Figure [TJ 
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1 3 2 1 3 2 -► 3 112 2 3 

13 5 7 

FIGURE 1. A possible transition from the state 132132, cor¬ 
responding to the bumping sequence (1,3, 5, 7). 


We now give a formal definition of the transitions. Let w = w\ ■ ■ ■ w n be a 
state in St ni ...., nr ■ and set, by convention, w n+ \ = oo. A bumping sequence 
for w is an increasing sequence of integers (a(l),..., a(k)) with length at 
most T + 1 such that o(l) = 1, a{k) = n + 1 and, for all j between 1 and 
k— 1, w a ij) < w a(j+ 1 ) (that is to say, the ball at position a(j ) is heavier than 
that at position a(j + 1))- We denote by B w the set of bumping sequences 
for w. For a e B w . we define the state w a resulting from w via the bumping 
sequence a by 


( 3 ) 


W; = 


^a(£— 1) 

m+i 


if i = a(£) — 1 for some £, 
otherwise, 


which is easily seen to belong to St nit ___ jUT . Returning to the example in 
Figure [l] with w = 132132, the longest possible bumping sequence is a = 
(1,3,5, 7) and indeed w a = 311223. 

We now turn to defining the transition probabilities, which means assign¬ 
ing a probability to each bumping sequence. As in the MJMC, these proba¬ 
bilities will depend on a sequence z\, z 2 ,... of nonnegative real parameters, 
whose interpretation is now the following. Suppose that we have constructed 
the i — 1 first positions (o(l),..., a(i — 1)) of a random bumping sequence, so 
that a(i) has to be chosen in the set {£\ a(i — 1) < £ ^ n + 1,W£ > w a ^_ 1 )}: 
Zj is then proportional to the probability that we pick a(i) as the j th largest]^] 
element in that set. Upon normalizing, we find that the actual probability 
of picking a specific a(i) can be written 

z J w (a(i),w a (i 1 )) 
yj w (a(i- l),UJ a (i_;L)) 

where we introduce the useful notation 


( 4 ) 


Qw,a{i) 


(5) yi = zi 4-h Zi, 

(6) J„ ; (m, t) = 1 + #{£\ m ^ ^ n,W£ > t}, 

for me {1,..., n} , t e {1,..., T} and i e {2,..., k}. All in all, the global 
probability assigned to the bumping sequence a is Ilt =2 Qw,a(i)- Noting 
that, for all states w,w' e St nit ___ >nT , there is at most one a e B w such that 
w' = w a , we define the transition probability from w to w' as 

j nt 2 Qw,a(j) if w' = w a for some a e B w , 

V ') “ w w l ~ < , 

0 otherwise. 


^If we replace “largest” by “smallest” here, then the MSJMC does not seem to have a 
simple stationary distribution anymore. 
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For instance, the transition of Figure [Ijhas probability 24 / 2/5 x 22 / 2/2 x £ 1 / 2 / 1 - 

Remark 2. The MJMC |Tj is recovered by taking T = 2, upon identifying 
l’s with balls (•) and 2’s with vacant positions (o). 


~3 . Z2 



Figure 2. Transition graph of the MSJMC with T = 3 and 
n\ = n 2 = n 3 = 1. 


Example 3. Figure[2]illustrates the MSJMC on and the corresponding 

transition matrix in the basis {123,132,213,231,312,321} reads 


( 8 ) 


2/3 2/2 

£3 
2/3 
£2 
2/2 
0 

1 
0 


Z 3 . zi 
2/3 2/2 

0 


V 


Zi 

2/2 

0 

0 

0 


12 

2/3 

0 


^ 0 

£2 
2/2 

0 

1 


£1 

2/3 

0 

0 

0 

0 

0 


£2 

2/3 

0 

£1 

2/2 

0 

0 


°\ 

£1 

2/3 

0 

0 

0 

0/ 


Observe that ( 2 / 12 / 22 / 3 ,2/i2/3,2/12/1, 2 / 1 Z/ 2 ,2/i2/2,2/i) is a left eigenvector with eigen¬ 
value 1, and thus is proportional to the stationary distribution. 


Remark 4. It is not difficult to check that generically (i.e. when all z* are 
nonzero), the MSJMC is irreducible and aperiodic, and thus admits a unique 
stationary distribution 7 r. 

Indeed, we can reach any state ir by the following procedure. Note that 
it suffices to reach a cyclic shift of 7 r, since we can always throw balls to 
the rightmost position. Start by positioning the heaviest balls, that is the 
balls labelled 1 as is done in 7 r. This can be done by the irreducibility of 
the unlabelled chain, studied in |Tj. Assume now by induction that balls 
labelled 1,... ,i have been positioned as in 7 r. The juggler will now throw all 
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balls labelled 1 ,..., i to the rightmost position and balls labelled i + 1 to the 
positions given by n. Those positions will be occupied by lighter balls since 
all heavier balls allready are sorted according to n. Those lighter balls can 
bounce to anywhere, the rightmost position for instance. After T transitions 
all balls labelled i + 1 have been sorted according to n. By induction we are 
done. 

Furthermore, the state l ni 2 n2 • • • T nT can be send to itself through the bump¬ 
ing sequence (1, ni + 1, rti + ri 2 + 1,..., n + 1), which proves the aperiodic.ity 
of the model. 


Our main result for this section is an explicit expression for 7r. 


Theorem 5. The stationary probability of w 6 S7m,...,n T is given by 

1 n 

( 9 ) ^(w) =-]\y Ew{i) 

2 = 1 

with the notation 


(10) E w (i ) = 1 + #{j\i j n,wj > Wi } = J w (i,Wi) 
where the normalization factor Z reads 

T 

(11) Z = | | hn i (?/l, ... , y n —ni - rii + 1 ) 

2=1 

with the complete homogeneous symmetric polynomial of degree t. 


Returning again to the example w = 132132, we have ir(w) = yXyiyzH'o- 
According to the general lumping strategy outlined in Remark [l] Theorem [5] 
is proved in Section 2.2 by introducing a suitable enriched Markov chain. 


2.2. The enriched Markov chain. The first idea to define the enriched 
Markov chain comes from expanding the product on the right-hand side of 
([ 9 ]) using the definition (|5]) of the yj's, resulting in a sum of monomials in 
the Zj's which is naturally indexed by the set of sequences v = iq ■ ■ ■ v n of 
positive integers such that V{ ^ E w (i) (with E as defined in (fTo])) for all 
ie {1,..., n}. Let us call such v an auxiliary word for w. This suggests that 
we can define an enriched state as a pair (w,v) where w 6 St ni: ,,^ nT and v 
is an auxiliary word for w. We denote by 5n lv .., nr the set of enriched states. 

The second idea, needed to define the transitions, is to use the auxiliary 
word to “record” some information about the past, in such a way that all 
transitions leading to a given enriched state have the same probability (this 
will be a key ingredient in the proof of Theorem [6] below). More precisely, 
given an enriched state (w,v), we consider as before a bumping sequence 
a £ B w , and we define the resulting enriched state (w,v) a = (w',v') by 
updating of course the basic state as before, i.e. we set w' = w a as in ([3]), 
while we update the auxiliary word as 


( 12 ) 


E w t{i) if i = a(£) — 1 for some £, 
Vi+i otherwise. 


For instance, in our running example w = 132132 and a = (1,3, 5,7), for 
v = 412211 we have v' = 142211. We may think of the auxiliary word as 
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“labels” carried by the balls, that are modified (maximized) for the bumped 
balls and preserved otherwise. The transition probability from (w, v ) to 
(w',v') is as before 


( 13 ) P(w t v),(w',v’) 


nf-2 Qw,a(i ) if («A v’) = («b v) a for some a £ B w , 
0 otherwise. 


It is clear that the enriched chain projects to the MSJMC. Indeed, we define 
an equivalence relation over «S ni nT by simply “forgetting” the auxiliary 
word, so that the equivalence classes may be identified with St ni nT (note 
that 1” is a valid auxiliary word for any element of St ni nj.). The lumping 
condition ([I]) is trivially satisfied, since we have P( w ,v),(w,v) a — Pu >,w a for all 
(w,v) in Sn lt ... tnT and a in B w , and P( WjV )t w ay) = 0 whenever ( w a ,v') A 
(w, v) a . 


Theorem 6. The stationary distribution of (w,v) in S ni nT for the en¬ 
riched chain is 

1 n 

( 14 ) = zYl z vi 

1=1 

where Z is the normalization factor. 


Proof We have to check that, for all (it/, v 1 ) £ S nx nT , we have 
( 15 ) P(w,v),(w',v')^(w,v) = tv(w',v'), 

(w,v)E<S n ^ .....nrj. 

which is done by characterizing the possible predecessors of (it/,i/). Let 
(w,v) be such that = ( w,v) a for some bumping sequence a £ B w . 

We will show in particular that a and w are uniquely determined from the 
data of (w',v') hence, as claimed above, all transitions to have the 

same probability. 

We start by explaining how to recover the bumping sequence a = (a(l), 
... ,a(k )) or, more precisely, its set of values A = (a(l),... ,a(k)}. Recall 
that 1 and n + 1 belong to A by definition. We claim that j £ {2,... ,n} 
belongs to A if and only if the following two conditions hold: 

(i) = E w f(j - 1), 

(ii) w'j _i < w j’-\ where j' is the smallest element of An {j +1,..., n+ 1}. 

Indeed, these two conditions are clearly necessary: (i) by ( |12[ ), and (ii) by 
([3]) and the requirement that Wj < wy when j < j' are both in the bumping 
sequence. Conversely, assume that j $ A, so that Wj = w'j_ 1 and Vj = 
By the definition of the MSJMC transitions, the subword w' 3 ■ ■ ■ w' n is 
a permutation of Wj +1 • • • w n w'-,_ l . Hence, recalling 

is equal to 1 if (ii) holds and to 0 otherwise. If (i) holds, we have E w /(j — 1) = 
v'j_i = Vj ^ E w (j), hence (ii) cannot hold. This completes the proof of our 
claim, which fully determines A (hence a) by reverse induction. 

Once we have recovered a, it is clear that w is uniquely determined, while 
we have Vj = , for j f A. All predecessors of (w/,r/) are then obtained 

by picking, for each j £ A\{n + 1}, Vj an arbitrary integer between 1 and 
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u j~i x i y^u)- 

jeA\{n+ 1} 


E w (j). This shows that 

(!6) 2 u ) = \ E[ Zv 'i- 

v:(w' ,v')=(w,v) a j&A 

The last observation we need is that 
(17) J w (a(i),w a{i _ i)) = J w ,(a(i),w' a{i) _ J = E w ,(a(i) - 1) = 

for all i £ {2,..., kj, since ■ ■ ■ w' n is a permutation of w a ^ ■ ■ ■ w n and 
since w a{l _ x) = w/ (j) _ r By @ and 0 we hnd that, for any predecessor 
(w, v ) of {w' , v'), 


( 18 ) 


Pt 


(w ,v) ,(w' ,v') 


n ie A\{i} 


Z„>. 


D-l 


□ 


I IjA/V frH-!} VE w {j) 

Combined with the desired stationarity condition ( |15[ ) follows. 

Proof of Theorem [5| The expression ([9]) is immediately obtained by applying 
the general lumping expression ([2]) for the stationary state, Theorem [6] and 
the definition of enriched states. It remains to check the expression ( [IT] ), 
which we do by induction on T. Let (j){w) = UE w (i p so tli a t Z is the 

sum of 4>(w) over all w £ St nir ,, tTlT . The expression (11) holds for T = 0, 
as Z = </>(e) = 1 where e is the empty word. For T ^ 1, let w be a word 
in St, ni and let w £ 5't n2i ... inT be the word obtained by removing all 
occurrences of 1 in w, and shifting all remaining letters down by 1. Denote 
by i\ > ■ ■ ■ > i ni the positions of l’s in w, and let jg = n + 2 — in — l, so 
that 1 ^ ji ^ ^ j ni <n-m + 1. The mapping w ^ (w, (ji,.. .,j ni )) 

is bijective, and it is not difficult to see from the definition ( |10| ) of E that 

ni 

(19) (f{w) = (/}(w)Y\yjf 

i =i 

Summing the product on the right-hand side over all sequences (ji,..., j n ,) 
yields the complete homogeneous symmetric polynomial h ni (yi ,..., y n - ni+ 1 ), 
and follows by induction. □ 


3. Multispecies juggling with fluctuating types 

Our goal is here to introduce multispecies generalizations of the add-drop 
and annihilation models developed in mm- Both models have the same 
state space and the same transition graph, but different transition probabil¬ 
ities. The state space is St the set of words of length n on the alphabet 
A = {1,..., T}. The number of balls of each type is not fixed anymore and 
thus there are T n possible states. The transitions are similar to the ones 
in the MSJMC, except that the type of the ball the juggler throws is inde¬ 
pendent of the type of the ball she just caught. This ball then initiates a 
bumping sequence as defined before. More precisely, starting with a state 
w = w\ ■ ■ ■ w n £ stl, we let w = w 2 • • • w n . Transitions involve replacing 
the first letter of w by an arbitrary j £ A, resulting in the intermediate state 
jw~, then applying a bumping sequence a £ Bj w ~, resulting in the final 
state ( jw ~) a , where (•)“ is defined as in (j3|. Defining transitions probabil¬ 
ities requires specifying how we pick j and a. The multispecies add-drop 
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and annihilation models differ in the way that we pick the new ball of type 
j and the position a( 2) where it is inserted, while the subsequent elements 
a( 3),..., a(k ) of the bumping sequence are then chosen in the same way as 
for the MSJMC. Figure [3 shows all allowed transitions for St 


Remark 7. Both chains are irreducible, since a state w\ ■ ■ ■ w n can be reached 
from any state in n steps by just putting a Wi in the rightmost position at 
the i-th step. The models are also aperiodic since the state l n can be send 
to itself by putting a 1 at the rightmost position.This remark also applies to 


the overwriting model, described later in Section 3.3 



o 



Figure 3. The basic transition graph on St^. Note that the 
first letter has no effect on which states can be reached. 


3.1. Add-drop model. In the add-drop model, choosing a ball of type 
j and sending it to the 7-th available position from the right is done with 
probability proportional to CjZ£ where, in addition to the previous parameters 
Z \, Z 2 , ■ ■ ■, we introduce new nonnegative real parameters c\,... ,ct that can 
be interpreted as “activities” for each type of ball. Because lighter balls can 
be inserted in fewer possible positions, the actual probability of choosing 
j and t has to be normalized, and reads CjZg/(^J =l Qyj, |! ( 2 .u) where w is 
the initial state and where we use the same notations ([5]) and ([6j as before 
(note that J w (m,t ) = Jj w -(m,t ) for all m > 1). As the position where the 
new ball is inserted is a(2) > 1, saying that it is the 7-th available position 
from the right means that l = J w (a(2),j). As described above, subsequent 
elements a(3),... ,a(k ) of the bumping sequence a are chosen in the same 
way as for the MSJMC, so that the global probability of picking a new ball 
of type j and a bumping sequence a e Bj w - is 

(20) Pw (j, a) = C f J “ (a(2)J) [] 

2jt=i c tyj w (2,t) i =3 

where we recall the notation Q. The multispecies add-drop juggling Markov 
chain is then the Markov chain on the state space St^ for which the transition 
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probability from w to w' reads 

( p w (j, a) if w' = (jw~) a for some j e A and a e Bj w -, 


( 21 ) 


Pw.w' 


0 otherwise. 

Note that we recover the add-drop juggling model |lj when we set T = 2. 

Example 8. The transition matrix of the multispecies add-drop Markov chain 
on the state space in the ordered basis {11, 21, 31,12, 22,32,13, 23,33} 
reads 


cizi 

Ai 

0 

0 

C 2 Z 1 

Ai 

0 

0 

C3Z1 

Ai 

0 

0 ^ 

cizi 

Ai 

0 

0 

C2Z1 

Ai 

0 

0 

C3Z1 

Ai 

0 

0 

cizi 

Ai 

0 

0 

C2Z1 

Ai 

0 

0 

C3Z1 

Ai 

0 

0 

0 

Cizi 

0 

ciz 2 

C 2 Z 1 

0 

0 

C 321 

0 

A 2 

A 2 

A 2 

A 2 

0 

ClZl 

0 

Cl z 2 

C 2^1 

0 

0 

C 321 

0 

A 2 

A 2 

A 2 

A 2 

0 

ClZl 

0 

Cl Z2 

C 2^1 

0 

0 

C3 21 

0 

A 2 

A 2 

A 2 

A 2 

0 

0 

ClZl 

0 

0 

C2Z1 

Cl 22 

C2Z2 

C 321 

A 3 

A 3 

A 3 

A 3 

A 3 

0 

0 

ClZl 

0 

0 

C 2 Z 1 

Cl 22 

C222 

C 321 

A 3 

A 3 

A 3 

A 3 

A 3 

0 

0 

ClZl 

0 

0 

C 2^1 

Cl 22 

C222 

C3Z1 

A 3 / 

A 3 

A 3 

A 3 

A 3 


( 22 ) 


V 

with the notation Ai = (01 + 02 + 03)^1 , A2 = ciy2 + (c2 + C3)yi and A3 = (ci + 
C2)y 2 + c 3 yi. One can check that (c\y\, c\ciy\,c\c$y\, cic 2 yiy2, c%yj, c 2 c 3 yf, 
cic 3 yiy2,C2C 3 yi?/2,c|?/f) is a left eigenvector for the eigenvalue 1. 

Theorem 9. The stationary pi^obability of w = w\ ■ ■ ■ w n 6 St^ for the 
add-drop model is given by 


(23) 


= 4n c ^iVE W (i)- 


z 


i= 1 


where the normalization factor Z reads 


(24) Z= J] {^■■■c^Ylh nt (y 1 ,...,y n _ ni _..._ ni+1 )\ 

niH h n T =n \ i =1 ) 

with hi the complete homogeneoiLs symmetric polynomial of degree t. 

Proof. We will again follow the strategy described in Remark [l] We consider 
the enriched Markov chain whose state space is the set Sf of pairs of words 
(w,v) with w e Stn and v = v\ ■ ■ ■ v n such that Vi ^ E w (i ) for all i e 
{1,... ,n}. Given (w,v) e S^, j £ A and a e Bj W ~, we define the resulting 
enriched state by setting w' = ( jw~) a , and 


(25) 


/ 

Va = 


Bw' (*) 

and the transition probabilities are of course given by : 


if i = a{l) — 1 for some l, 
otherwise. 


(26) 


Pi 


(w ,v) ,(w',v') 


Pw(j, a) if (w', v') = (w, v) 1 - for some j £ A and a 6 Bj w ~, 


0 


otherwise. 


with p as defined in (20). 
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We will now show that the stationary probability of (w, v ) 6 for the 
enriched add-drop model is given by 


(27) 


1 n 

n(w,v) = - \ [ 


Z L 


Cqi ]- Z -ji 


which will give us equation (23) by lumping. 

We have to check that, for all (w',v') e Sj t . we have 


(28) 


X = Tr(w',v'). 

(w,v)eST 


Let ( w',v ') be a state in S J. For a given ( w',v' ) we can deduce most 
of a possible predecessor (w,v). As in the proof of Theorem [6] we can first 
deduce the the bumping sequence a, then the type j of the added ball. This 
means that W 2 , ■ ■ ■, w n and Vi,i £ A are uniquely determined. Recall that for 
a = (a(l),..., a(k )) we defined A = (a(l),..., a(k)}. Let W = jw 2 ■ ■ ■ w n . 
We have : 

1 T 

( 29 ) X tt(u;,i;) = ^X^-Ma-oll^-i 11 KW' 

(w,v):(w f ,v')=(w,v)j i— 1 ^eA\{l,n+l} 


Furthermore, by observing that J w (a(i),w a r i _i' ) ) = (as in equation 
©) we have, for all (w,v) such that (w,v)j = (w',v r ), 


(30) 


(w,v),(w' ,v') 


CjZj w{a{ 2),j) riteA\{l,a(2)} S-i 
2i=l c tUj w (2,t) rifeA\{l,n+l} VEwW 


Combined with (29), the desired stationarity condition (28) follows. 


□ 


3.2. Annihilation model. In this section, we assume that hopping param¬ 
eters are probabilities, z\ + ■ ■ ■ + z n +i = 1. In this model, we consider that 
the juggler first tries to send a ball of type 1. She chooses £ £ {1,..., n + 1} 
with probability Z£, and tries to send the ball at the 7-th available position 
(counted from the right as before). If £ is a valid position (that is, it is not 
larger than the number of available positions for the 1), there is a bumping 
sequence whose subsequent elements are drawn in the same way as for the 
MSJMC. Otherwise, she tries instead to send a 2 according to the same pro¬ 
cedure, etc. In the end, if she did not manage to send any ball of type in 
{1,...,T — 1}, she just sends a T to the righmost position. Note that failing 
to send a ball of type t for an initial state w is done with probability 


(31) l ~yj w ( 2 ,t)- 

Globally, the probability of picking a new ball of type j and a bumping 
sequence a e B 1W - reads 


(32) 


Qw{j,a) 


j —1 k 

z J w {a(2),j) E[(l- yJw(2,t)) 0 Qw,a{i) 
t =1 i =3 

T—1 

n ( x _ yjAu)) 

. t= 1 


if J < T, 
if j = T, 
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note that j = T implies a = (1 ,n + 1). The transition probabilities of the 
multispecies annihilation juggling Markov chain are obtained by replacing 
p w (j, a) with q w (j, a) in (21). Note that we recover the annihilation juggling 
model |Tj when we set T = 2. 


Example 10. The transition matrix of the multispecies annihilation Markov 


chain on the set space St% in the ordered 
reads 



( Z\ 

0 

0 

zi(z 2 + z 3 ) 

0 


Zl 

0 

0 

zi{z 2 + z 3 ) 

0 


Z 1 

0 

0 

zi{z 2 + z 3 ) 

0 


0 

zi 

0 

z 2 

ZlZ 3 

(33) 

0 

Zl 

0 

Z 2 

ZlZ 3 


0 

Zl 

0 

Z 2 

ZlZ 3 


0 

0 

Zl 

0 

0 


0 

0 

z 1 

0 

0 



0 

Z1 

0 

0 

Note that ( 

z i 

z\{z 2 + Z 3 ),Zl(z 2 

} + z 3 ) 2 

^1^3("2 + Z 3 ) 2 , 

(zi 

z 2 )(z 2 + z 3 f 

\z 3 (zi 

eigenvector 

for 

the 

eigenvalue 1. 



basis {11, 21, 31,12, 22, 32,13, 23, 33} 


0 

(z 2 + Z 3 ) 2 

0 

°\ 

0 

(Z2 + Z 3 ) 2 

0 

0 

0 

(Z2 + Z 3 ) 2 

0 

0 

0 

0 

(Z2 + Z 3 )z 3 

0 

0 

0 

(z 2 + Z 3 )z 3 

0 

0 

0 

(z 2 + z 3 )z 3 

0 

^l~3 

z 2 

ZlZ 3 

z 3 

ZlZ 3 

Z 2 

ZlZ 3 

4 

Z\ z 3 

Z 2 

ZlZ 3 

4 / 


,zi(zi + z 2 )(z 2 + z 3 ),zfz 3 (z 2 + z 3 ), 
+ Z 2 )(z 2 + z 3 ) 2 , z 2 (z 2 + z 3 ) 2 ) is a left 


Theorem 11. The stationary probability of w = w\---w n £ St^ for the 
annihilation model is given by 


T #{m\wm^t} 

(34) 7r(w) = I J] y Ew(i) ] I n n (! - Vp) I • 


\i=l,Wj<T 


£=2 p= 1 


Moreover, here no normalization factor is needed as 
(35) ^ 7r ( lt7 ) = (zi + ■ ■ ■ + z n+1 ) n( - T - 1 ' ) = 1. 

weStf 


The stationary probabilities of enriched states are no longer monomials 
in the zf s, which suggest that a further enrichment is possible as already 
observed for the case T = 2 in Section 4.2 of [I]. 


Proof. The theorem is proved by enriching the chain as before. We again 
use the state space for the enriched multispecies annihilation Markov 
chain, just as for the enriched multispecies add-drop Markov chain in Sec¬ 


tion 3.1 The transitions are defined in the same way too, only the transition 
probabilities change : 

(36) 


(w,v),(w' ,v') 


Qw(j, a) if (w 1 , v') = (w, v)? for some j 6 A and a £ B~ w -, 


0 


otherwise. 


with q as defined in (32). We will now show that the stationary probability 


of (w, v ) £ w = w\ • • • w n , v = v\ ■ ■ ■ v n is given by 

n T #{m\wm>i} 

n(w,v)= n ^ n n 

i=l,Wi<T 1=1 p= 1 


( 37 ) 
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Once we prove this, we will obtain a proof of (34) by lumping. To do so, we 
have to check that n satisfies 


(38) 


Y P(w,vUw>,v')Tt{w,v) = n(w',v'). 

(w,v)eSZ 


Let (it/, v') be a state in 5+ We do not have a lot of choice in choosing 
a predecessor (w,v) of (it/,i/); the bumping sequence a, the type j of the 
added ball, W 2 , ■ ■ ■, w n and Vi,i$ A, where as before A is the set of values in 
a, are uniquely determined (this works exactly as for the proof of Theorem 
[6]) . Let W = jw 2 • • • w n . We define : 


n 

c = U z < 

i=l, w^kT 

{rii£A\{l.a(2)} Z v ' i _ 1 

Zj w(A2)J) [l isA \ lhn+1) yE w (i) 

c" = n vew® n ** 

ieA\{ l,7i+l} A 

Wi<T Wi<T 

T #{m\w' m M} 

D = U n i'-yp) 

1 =2 p =1 
3 - 1 

D' = ]^[(1 - yj w ( 2 ,i)) 

i= 1 

T #{m^2\w rn ^£} 

- n n t 1 -».) 

t =2 p =1 


if j<T, 

otherwise. 


T wi 

K= Y W 1 ) n ^ 1 ~ y#{m.^2\w m ^t}+l) 

101 = 1 1 =2 


First, we note that C'C" = C. Recall that j = T implies A = {1, n + 1}. 
Secondly, we have D'D" = D, since J\y(2,i) = #{m ^ 2\w m > i} + 1. For 
all (w,v) such that P( w , v )t w ', v ') ^ 0, we have 


(39) 


Pi, 


= C'D', 


(w ,v) ,(w',v') 

where the C' follows from ( |T7| ) and Q and D 1 follows from plj ). Note that 
the transfer probability does not depend on the choice of (w, v ). Now, 


(40) 


Y 7f(u>, v) = C"D”K , 

(w ,v): (w' ,v') = (w ,v)j 


where the i = 1 case has been removed from C" and collected in K. Further¬ 
more, K = 1, since it is telescoping sum using that E W1 W2 ... Wn (l) = #{m ^ 
2|u; m > wi} + 1, (start with adding the cases w\ = T and w\ = T — 1 
together). The desired condition (38) follows. 


□ 
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3.3. Overwriting model. The aim is here to describe a multispecies gen¬ 
eralisation of the annihilation model studied in |lj in which the ultrafast 
convergence property holds, namely we want the stationary distribution to 
be reached in a finite number of steps, independent of the starting distribu¬ 
tion. Let P be the transition matrix of a Markov chain (which is assumed to 
be irreducible and aperiodic). Saying that this Markov chain has the ultra¬ 
fast convergence property is equivalent to saying that there exists an integer 
m such that P m is the matrix whose rows are copies of the left eigenvector of 
P for the eigenvalue 1, or to saying that P has only one nonzero eigenvalue 
(which is 1). 

3.3.1. Model description. The set space St B is, as described in Section [ 3 J is 
the set of words in {1,..., T} n , and the transition probabilities are dictated 
by the indeterminates z 1 , • ■ •, z n+ 1 satisfying z\ + Z 2 + ■ ■ ■ + z n+ 1 = 1 as in 
Section 13.21 

In the overwriting model , each integer gets a chance to overwrite an integer 
larger than it. More formally, the transitions are described by a the following 
process. Initially, the 1-st letter is erased, and everything is moved to the 
left by 1 step. Now the juggler first tries to send a ball of type 1; she chooses 
i £ {l,n + 1} with probability Zj. and aims for the i th available position, 
meaning those positions which contain an integer greater than 1 (counting 
from right as before). If i is greater than the number of available positions 
for a 1 to land, the juggler simply fails to send a 1, otherwise the 1 lands 
to some position, destroying the ball previously occupying it if it isn’t the 
righmost position. She then tries to send a 2, which can only land in a higher 
position than the 1 did (any available position if the 1 didn’t land), or fail 
to land. She then tries to send a 3, and so on. If, after trying to send a ball 
of each type in {1,..., T — 1}, no ball landed to the rightmost position, she 
puts a T in that position. Otherwise, the new state is reached as soon as a 
ball is sent to the rightmost position. 

For w 6 St T, we define an overwriting sequence B = ((b\, ti),..., (&&,£&)) 
for w as follows : 1 < 61 < 62 < ... < bk = n + 1, 1 ^ f 1 < £2 < • • • < tk ^ T, 
and for alii = 1 ,... ,k, ti < Wbi with, by convention, w n+ 1 = + 00 . We denote 
by B w the set of overwriting sequences for w. 

For w 6 St B and B e B w , the state in St B obtained by applying the 
overwriting sequence B to the word w, denoted w B is defined as 

. . R i, if i = bj — 1 for some 7 

(41) wf = \ ] fV J 

I Wi+i otherwise. 

Note that the probability for the juggler to fail to send a ball of type t during 
the j-th part of the overwriting is given by 

( 42 ) 1 ~ yj w (bj_ 1 + 1 ,£) 

with the convention that 60 = 1 and where J is as in ([ 6 ]) Note that this 
returns 1 if a ball has already been sent to the rightmost position. The 
probability for the juggler to succeed in sending a ball of type tj to position 
bj — 1 during the j-th part of the overwriting is given by 

(43) 


^ J w {pj ftj ) * 
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rv\\ uA\ 6 \ 

3146253 - - 146253* - - 146253* - -126253*- - 126253* - - 126243* - - 126243* 

(1 - 9c>lU - I0)(1 - yi)Z5Z2 

-*• 1262436 

FIGURE 4. A transition in the overwriting multispecies 
Markov chain on Sty 

Example 12. In Figure [4j we describe the transition from the state 3146253 
to the state 1262436 in the state space Sty. The corresponding overwriting 
sequence is given by ((3, 2), (6,4), (8, 6)) and the probability of this transition 

is (1 - 3/6)25(1 - 2/3)22(1 - 2/i)■ 



FIGURE 5. The overwriting multispecies Markov chain on 
St' 2 - Here Xi = 1 — ;//*_ 1 . 

Given z\,..., z n+ 1 nonnegative real numbers summing to 1, we are now 
able to define the transition probabilities for the annihilation multispecies 
Markov chain : for w,w' e St B if there exists B e B w such that w' = w B , 
the transition probability from w to w' reads : 

k tj 1 

(44) Vw, W ' = Y[{ 0 (i-yjwibj- 1 + M))) 0 Z Jw(bj,tj) j 

j= 1 t=tj — 1+1 j\tj=£T 


and it reads 0 otherwise. 
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Example 13. The transitions of the overwriting Markov chain on Sty are 
represented in Figure [5] 

The stationary distribution of the overwriting chain does not have a simple 
formula, unlike the add-drop and annihilation multispecies variants. How¬ 
ever, we do obtain an indirect formula in terms of the enriched chain, which 
we state as Corollary [17] in the next section. It turns out that the occupation 
probability for the last site and the joint occupation distributions at the last 
two sites have particularly simple expressions, which is what we state next. 


Theorem 14. The stationary probability of having a j at the last site is 
given by 

zi(l - zi} 7-1 if j < T, 
if j = T. 

The joint probability of having an i at the n — 1-th site a 
site is given by 


(Wn = j) = 


= A = 11 - _ y2 )min(i,j)-l 


(Wn-1 = i, W n = j ) = (1 - Zi) 


X < 


a j at the n-th 

zm 

ifi<j<T, 

z i 

if j <T, 

2/2 

css. 

A 

II 

4 

Zl 

if j < i = T, 

1 

b) 

II 

II 

•<s> 


The proof is given in the following section, by constructing an enriched 
chain, and analysing the transitions therein. 


3.3.2. Staircase tableaux enrichment. It is now natural to look at staircase 
tableaux, as was done for the original juggling model in [7]. The state space 
for the enriched version of the overwriting chain on St£ is the set of Young 
tableaux of shape (n, n — 1 ,..., 2,1), with the following conditions on the 
entries in cells. 

(1) Entries belong to the set {1,..., T — 1}. 

(2) Entries appear in increasing order from left to right, and from bottom 
to top. 

(3) Empty cells are allowed. 

This set of tableaux is denoted by . For V e we will denote by 
the k- th column, from the left, of V (which has n + 1 — k cells). 

The transitions of the enriched Markov chain are as follows. At each step, 
the entries in the bottom row are deleted, all remaining entries are moved 
one step down and one step right, and we add entries to the leftmost column 
so that the tableaux conditions above still hold. More precisely, we proceed 
in the following way. We first try to add a 1 by choosing a number k\ in 
{1,..., n + 1} and placing a 1 in the Ai-th free position (from top to bottom; 
a position is “free” if and only if there is no 1 in the same row). If k\ is 
greater than the number of free positions, no 1 is added. We then similarly 
try to add a 2 by choosing &2 hi {1,..., n + 1} and placing a 2 in the A^-th 
free position, a position being free if there is no 1 or 2 in the same row, and 
having no 1 above it. We continue this way until all numbers between 1 and 
T — 1 have been tried. 
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For V e 7rf, for i e {1,..., Tj and k e {1,... ,nj, we introduce the useful 
notation : 


(45) C v (i,k) 


r 

H +#{cells above entry i mV**., with no entry j ^ i to the right}) 

if i is in V* k 

< 

1 2/#{cells in V*.r with no entry j ^ i in, to the right or on top}) 

otherwise. 


Here we use the convention that yo = 0. 

Example 15. Figure [6] gives the example of a state in and all possible 
states that it can transition to (with transition probabilities below the cor¬ 
responding arrows). If we call V the topmost tableau, we have for example 
CV(3,1) = 1 - yo = 1 and C v { 2, 2) = z*. 



Figure 6 . A state and its successors. Here Xj = 1 — y%-\ - 


The probability of such a transition V —► W is then given by 

jO if Wij A Vi-i.j-i for some 2 j i sS n 

(46) V v ,w = \ n r_i - ( . . , 

I j [ i=1 Cw(z, 1) otherwise 

This chain lumps to the overwriting model by the following procedure. Let 
the rows of the tableaux be numbered from bottom to top. For V be a 
tableau in 7^, we define, for he {1,..., n}, 


(47) 


ay(k) 


leftmost entry on the n — k + 1-th row of V 




if this row is not empty 


T 


otherwise. 
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The resulting lumped word w £ St^ is then given by 
(48) w = a(V) : = ay( 1) ■ • • ay(n). 

One can check that this procedure satisfies all the conditions for lumping, 
see Remark [l] We are now in a position to prove Theorem 

Proof of Theorem m The probability of having a j in the last site of w £ St^ 
in the overwriting chain is the same as the probability of having a j in the 
topmost cell of V £ if j < T, or of having nothing in this cell if j = T. 
This means that any number i < j failed to reach the first available cell, 
which happens with probability 1 — z\ for each one of them, and if j < T, j 
reached that cell, which happens with probability z i, which proves the first 
part of the theorem. 

For the second part of the theorem, we will only treat the case i < j < T, 
since all the cases are proved in a similar fashion. The joint probability of 
having a i in the (n — l) th site and a j in the n th site of we St^ is the same 
as the probability of being in one of the two configurations of Figure [7J 


j 

i or empty 

j 



i 





i 
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Figure 7. The two possible cases for i < j < T. 


The transition probability into the first configuration is 
(49) (1 - zi Y x (1 - y 2 x 

no k ^ i in the topmost no k < i in the top 2 i is in the 2 nd 

cell of the 2 nd column cells of the 1 st column cell of the 1 st column 

x (i - zx = {i-z 1 y~ 1 {i-y 2 y~ 1 z 1 z2, 

no k between i + 1 and j — 1 in the j is in the topmost 
topmost cell of the 1 st column cell of the 1 st column 

while the transition probability into the second configuration is 


(50) 


(1 - zi) 


i —1 


no k < i in the topmost 
cell of the 2 nd column 


(i-^r 

V__> 

'\r 

no k between i and j — 1 in the 
topmost cell of the 1 st column 


i is in the topmost 
cell of the 2 nd column 

X Z\ 


X (1-2/2) 


i —1 


no k < i in the top 2 
cells of the 1 st column 

Y7— 1 


= c 1 -*! y 1 (1—2/2) * 1 zf 


j is in the topmost 
cell of the 1 st column 


By summing (49) and (50), we get the desired probability. 


□ 


The idea of this proof also hints at why the stationary distribution of the 
overwriting Markov chain is not of a simple form. However, we will show 
that the stationary distribution of the enriched Markov chain on staircase 
tableaux has a particularly nice structure. 
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Theorem 16. The stationary distribution of V e for the staircase 
tableaux enriched Markov chain is given by 

n T -1 

u(v) = Y\Yl c v(i,k) 

k= 1 i= 1 

with the normalisation factor (z,\ + • • • + z n+ = 1. 


We will prove this formula by considering an even larger enlargement of the 
Markov chain on staircase tableaux, analogous to the doubly enriched chain 
of the single species annihilation model in [T, Definition 4.14], An immediate 
corollary of this result is the formula for the stationary distribution of the 
overwriting Markov chain 


Corollary 17. The stationary probability of w = w\ ■ ■ ■ w n e St^ for the 
overwriting model is given by 


(51) 


n(w) 


where a(V ) is defined in (48). 


2 n(n 


VeT,f 

a(V)=w 


3.3.3. The doubly enriched chain. In this section we will construct a general¬ 
ization of the doubly enriched chain of the single species annihilation model 
in |1, Definition 4.14], which was a Markov chain on words of length n. In 
this case, the natural extension of this Markov chain is to matrices. The 
state space is the set of matrices with T — 1 rows and n columns with 
entries in {1,..., n + 1}. 

It is clear there are (n+l)”^ -1 -* different states. As usual, given z±,..., z n+ 1 
nonnegative real numbers summing to 1, the transitions are defined as fol¬ 
lows. For M 6 Tjf, all transitions from M are obtained by deleting the last 
column in M, shifting all the remaining columns to the right by one, and 
adding an arbitrary column on the left. The probability of this transition 
is given by the product of factors z t for each element i in the resulting first 
column. More precisely, 


(52) V m ,n 


ru z Ni ,i 

0 

V 


if N k ,i = M k ,i- 1 for all k e { 1 ,..., T - 1} 
and all l e {2,..., n}, 

otherwise. 


Since this is a product of T— 1 independent copies of the single row Markov 
chain, it is clear this Markov chain is recurrent. Further, the stationary 
distribution is given, for M e T^, by the product 


(53) 


T—1 n 


n (M) = nn-,- 

i=l j =1 


with normalisation (zi + • • • + z n ) n ^ T ^ = 1. 


Remark 18. The dynamics of the doubly enriched chain guarantee that the 
stationary distribution is reached after n steps (indeed, the first state has 
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been completely forgotten after n steps), which is the desired ultrafast con¬ 
vergence property. Equivalently, n is a deterministic strong stationary time 
for this chain. 

An immediate consequence of Remark [T8] is a complete description of the 
spectrum of the transition matrix, given by the following theorem. 

Theorem 19. Let n,T e N, and let M be the transition matrix of the doubly 
enriched chain on ■ The eigenvalues for M are 1 with multiplicity 1 and 
0 with multiplicity n — 1. 

Proof. As stated before, the stationary distribution is reached after n steps. 
This means that M n is the Matrix with all the rows being the left nor¬ 
malised eigenvector for M (which represents the stationary distribution). 
Thus, M n+1 = M n . and therefore X n+1 — X n is a nullifying polynomial for 
M. This shows that 1 is an eigenvalue of multiplicity 1 (we already knew that 
its multiplicity was at least 1) and that 0 is the only other eigenvalue. □ 

The doubly enriched Markov chain on matrices described above lumps 
onto the singly-enriched chain on staircase tableaux. Let M be in ■ We 
will construct a tableau T associated to M by starting with an empty tableau. 
We then fill T according to the following pseudocode. 

• for k decreasing from n down to 1: 

• for i increasing from 1 to T — 1: 

• if Mi k is less than or equal to the number of available positions in 
the Afth column of T: 

• insert i in the M^/dth position from the top 

• else: 

• do not insert i. 

We then set A(M ) := T. One can check that this algorithm leads to an 
actual lumping between these two Markov chains, see Remark [l] 

Example 20. Figure [8] gives the example of a matrix M in and the tableau 
T in Ti it lumps onto. This tableau T can then be lumped onto iv = 1243 
in St\. 


1 4 3 2 1 \ 

3 5 5 2 

\ 1 4 1 1 / 



Figure 8. A matrix and the tableau it lumps to. 


Remark 21. Since lumpings preserve the ultrafast convergence property, both 
the chain on staircase tableaux on 7^ and the overwriting Markov chain on 
Stn converge in n steps. 

We now prove the formula for the stationary distribution of the Markov 
chain on staircase tableaux. 
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Proof of Theorem 16 We have to check that, for each V e , 


2 n (M) = n(v) 

MeTff 
Me A “hU) 


To do so, let k e {1,..., n} and i e {1 ,..., T — 1}. If i appears in the k th 
column of V, then every M in projecting to V, must verify 

Mj k = ^{cells above entry i in I4,fc, with no entry j ^ i to the right} 

because of how the projection is defined. Similarly if i does not appear in 
the k th column of V, then M l k must be greater than 

cells in with no entry j ^ i in, to the right or atop of them}. 

In both cases, summing over all the possible values £ of M, L *. gives us 
Cy(i, k ), and thus proves the result. □ 


4. Several jugglers 

We now consider a completely different generalization of Warrington’s 
model m Instead of a multivariate or multispecies generalization, we will 
now consider that there are several jugglers, and that each one of them can 
send the balls she catches to any other juggler. We model this situation as 
follows. For r, c,£ nonnegative integers such that £ ^ rc, we denote by S rxc 
the set of rectangular arrays with r rows and c columns, such that each cell 
either is empty or contains a ball, and by S rxc £ c: S rxc the subset of arrays 
containing exactly £ balls. Each column represents the balls that are sent to 
a specific juggler. For A and B two arrays in S rxc , we denote A~ the array 
obtained by removing all the balls in the lowest row, and moving all the 
other balls down one row (hence the topmost row of A~ is always empty). 
We write A c B if all the balls in A are also in B. For i between 1 and r, we 
denote by Ai the number of balls in the i-th row (rows are numbered from 
top to bottom). 

The several jugglers Markov chain is the Markov chain on the state space 
Srxc/ whose transition probabilities read, for A, B e S rxc /, 


(54) 


Va,b 


1 


( rc-t+Ar ) 

0 

V 


if A c z B, 
otherwise. 


Here, A r is the number of balls in the lowest row of A. which is exactly 
the number of balls the jugglers will have to send back. These A r balls 
are reinjected uniformly in the rc — £ + A r available positions, under the 
constraint that no two balls go to the same position. Note that there are no 
balls reinjected when A r = 0, and V a a~ = 1 i n this case. The irreducibility 
and aperiodicity of the several jugglers Markov chain are easy to check. 
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1 O 



6 


FIGURE 9. The several jugglers Markov chain on the set 
space S , 2 x2 ,2- 


Example 22. The transition Matrix of the several jugglers Markov chain on 
the set space $2x2,2 ™ the basis ordered (1, 2,3,4, 5,6) on Figure [9] reads 


(55) 


3 

VI 


1 

6 

0 

o 

i 

! 

3 

0 


1 

6 

0 

0 

1 

I 

3 

0 


W 

0 

0 

0 

0 

0 / 


Note that (6,3,3,3,3,1) is a left eigenvector for the eigenvalue 1. 

Again, we have an explicit expression for the stationary distribution of 
this Markov chain. 


Theorem 23. The stationary probability of A e S rxc ,l f or the several jug¬ 
glers Markov chain reads 

(56) -k{A) = PJ (ci - A Ki ) A 

Z rxc,£ f = \ 

where A<j = A\ + ■ • • + Aj„i is the number of balls strictly above row i, 
(x) n = x(x — 1) • • ■ (x — n + 1) is the Pochhammer symbol and Z rxc £ is the 
normalization factor. 

Remark 24. We didn’t find a simple expression for the normalization factor 

Zr x c,l ■ 

Proof. We introduce an enriched chain as follows. A state in the enriched 
chain is an (r + 1) x c array with t arcs, each arc going between two cells that 
are not in the same row. For each arc we mark the top cell with a cross and 
the bottom cell with a ball. Each cell can contain at most one cross and at 
most one ball, but could have one ball and one cross belonging to different 
arcs. The projection to S rX c,e is obtained by simply removing the top row, 
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Figure 10. All the states in the enriched chain projecting 
to the state in 52x2,2 with both balls in the right column. 

all arcs and crosses but leaving the balls in place. See Figure [lO] for all the 
states of the enriched chain projecting down to the rightmost state in Figure 

m 

The transitions in the enriched chain are obtained by first moving all arcs, 
balls and crosses down one row in the array. Secondly, if there were balls in 
the bottom row, they and the corresponding arcs and crosses are removed. 
The balls are reinjected uniformly into the array except for the top row and 
under the condition that no two balls may be in the same cell, just like in 
the several jugglers Markov chain. For each of these balls an arc is inserted 
from the ball and up to a cross positioned uniformly in the top row under 
the condition that no two crosses can be in the same cell. (Alternatively we 
could define the transitions such that the new crosses in the top row appear 
in the same columns as the removed balls.) 

Now we note that if we run the enriched chain backwards, it will be an 
identical chain with the roles of balls and crosses exchanged (turned upside 
down). The number of balls in the bottom row in a state is equal to the 
number of crosses in the top row for every state it may transition to. Also 
the number of ways to inject balls is the same as the number of ways of 
removing crosses. It follows that the number of transitions out of any state 
is equal to the number of transitions into the same state. Thus the stationary 
distribution is uniform for the enriched chain. 

The uniformity of the enriched chain means that, to evaluate the station¬ 
ary probability tt(A) of a state of the several jugglers Markov chain, it suffices 
to count the number of states in the enriched chain projecting to it. For each 
ball we can place the cross in any position in a row above with the constraint 
that no two crosses can be in the same cell. The number of possibilities can 
be counted row by row: assuming that the crosses corresponding to the balls 
strictly above row j have been chosen, there remains cj — A<j cells without 
crosses that may be matched with the Aj balls in row j. hence there are 
(cj — A < j) a possible choices for row j. 

□ 

Remark 25. In [10], J.S. Kim studied the model of a juggler with each site 
being allowed to countain up to a certain number c > 1 of balls. This model 
can be obtained from the several jugglers Markov chain by a lumping. 

5. Open Problems 

Several questions remain open in the multispecies juggling context. We 
have not found an expression for the normalization factor for the juggling 
chain with several jugglers. We have also not yet found a multiparameter 
version for the latter model, as the possibility of catching more than one ball 
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at a time changes the behavior quite drastically. A multispecies model with 
several jugglers is one possible extension of our model. From a probabilistic 
point of view, it would also be natural to look atthe extension to infinite 
models, such as a Markov chain on the set space 5't nir .. inT _ 1)00 . This would 
contain as special cases, the infinite and unbounded juggling models [Tj. 
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